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We propose that condensed matter phenomena involving the spontaneous emergence and dynam- 
ics of crystal lattices can be realized in the setting of ultracold Bose-condensed atoms coupled to 
multimode cavities. Previously, it was shown that in the case of a transversely pumped single-mode 
cavity, the atoms self-organize at either the even or the odd antinodes of the cavity mode, given 
sufficient pump intensity, and hence spontaneously break a discrete translational symmetry. Here, 
we demonstrate that in multimode cavities the self-organization brings the additional feature of 
continuous translational symmetry breaking, via a variant of Brazovskii's transition, thus paving 
the way for realizations of compliant lattices and associated phenomena, e.g., quantum melting, 
topological defects, frustration, glassiness, and even supersolidity; such phenomena are absent in 
ultracold atomic systems when the optical lattices are externally imposed. We apply a functional 
integral approach to this many-body cavity QED system, which enables us, inter alia, to calculate 
transition thresholds, explore fluctuations near this transition, and determine how such fluctuations 
are manifest in the light emitted from the cavity. 

PACS numbers: 



I. INTRODUCTION 

Since the development of modern laser cooling and 
trapping techniques pQ, a wide range of phenomena as- 
sociated with traditional condensed matter physics — 
ranging from Mott insulators [2j [3] to Tonks-Girardeau 
gases [4 — have been realized in ultracold atomic systems. 
The value of these realizations stems from their exquisite 
tunability and purity. A shortcoming of traditional op- 
tical lattice settings, however, lies in the artificial nature 
of the lattice itself: its potential wells are fixed by exter- 
nal lasers, rather than arising spontaneously from many- 
body effects, which generate spatial structure in liquid 
crystals, solids, and even glasses. Therefore, several ar- 
eas of condensed matter research — e.g., soft condensed 
matter physics [5 , as well as phenomena such as super- 
solidity [6] — have remained inaccessible to the physics of 
ultracold atoms in artificial optical lattices, because of 
the absence of an emergent, compliant lattice, capable 
of exhibiting, e.g., dynamics, defects, and melting. Tun- 
able ultracold-atom versions of these condensed matter 
situations are especially welcome, as several fundamental 
issues remain unresolved, such as the dynamics of glassy 
media. 

A major advance toward self- generated, dynamical op- 
tical lattices was the discovery of cavity-induced self- 
organization [7JIHJE], which may be explained as follows. 
Consider TV two-level atoms in a single-mode optical cav- 
ity, interacting with the cavity mode and a pump laser 
oriented transverse to the cavity axis. The atoms coher- 
ently scatter light between the pump and cavity modes. 
Atoms arranged at every other antinode of the cavity field 
(i.e., one wavelength A apart) emit in phase and populate 
the cavity with photons, leading to the collective, super- 
radiant enhancement of the atom-cavity coupling by a 



factor proportional to the number of organized atoms. 
If the pump laser is of sufficient intensity and is red- 
detuned from the atomic transition (so that the atoms 
are high- field seekers), an instability arises: the superra- 
diance makes atoms couple more strongly to the cavity 
mode, thus trapping themselves at either the even or the 
odd set of antinodes, which leads to greater superradi- 
ance, stronger trapping, and so on. The system reaches 
a spatially modulated steady state when the energetic 
gain from superradiance is balanced by the cost, in ki- 
netic energy or repulsive interactions, of confining the 
atoms to the even or odd sites of the emergent lattice. 

Signatures of this symmetry-breaking, nonequilibrium 
phase transition have been observed experimentally [10] , 
and the resulting cavity-assisted laser cooling has been 
suggested as a method for cooling non-two level atomic or 
molecular systems [11 . Although this transition has been 
treated in a mean-field approximation for a single-mode 
cavity, the threshold for this transition has not been 
calculated beyond mean-field theory, which is crucial 
for analyzing the technique's utility for molecular laser 
cooling — a potentially ground-breaking prospect [12] . 

Our interest in atomic systems confined in multimode 
cavities stems from the vast family of possibilities for 
ordering and fluctuations that they can sustain. Single- 
mode cavities, unlike externally imposed optical lattices, 
feature a lattice amplitude that is emergent and a discrete 
symmetry breaking between even and odd antinode or- 
dering. However, the locations of the lattice antinodes 
are not themselves emergent, instead being fixed by the 
cavity geometry. By contrast, even in the simplest mul- 
timode cavity (i.e., the ring cavity, which supports two 
counterpropagating modes) the atoms collectively fix the 
locations of the antinodes, thus spontaneously breaking 
a continuous translational symmetry. As in real crys- 
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der (arising from the Bose-Einstein condensation of the 
atoms) as well as emergent crystalline (diagonal) order. 
A key difference between our system and those studied in 
Refs. [15] [16] is that the solidity is associated with a bro- 
ken continuous symmetry, and can therefore be used to 
perform ultracold-atomic versions of experiments study- 
ing the transport properties of supersolids [6 . 

To date, a key theme in AMO research has been the 
vision of using atoms to simulate the quantum dynam- 
ics of electrons propagating through static (i.e., "hard") 
lattices. One of the aims of this paper is to suggest that 
the ultracold atomic physics setting of cavity QED may 
be brought to bear on systems that are "soft," possessing 
spatial structures that are readily deformed by stresses 
and fluctuations — a possibility that is viable precisely be- 
cause the lattice itself is a dynamical entity. 



FIG. 1: The layered atom-cavity system. The cavity is 
transversely pumped by two counterpropagating lasers, which 
create a deep optical lattice, and confine atoms at the antin- 
odes of this lattice. In the depicted situation, the atoms oc- 
cupy a single equatorial antinodal layer. 



tals, this results in an emergent rigidity with respect to 
lattice deformations. In cavities possessing a family of 
degenerate modes, one can anticipate realizing further 
phenomena associated with crystallizing systems, includ- 
ing topological defects such as dislocations and domain 
walls. 

The purpose of this paper is to develop a field- 
theoretical framework for exploring the quantum statis- 
tical mechanics of correlated many-atom, many-photon 
systems confined in multimode optical cavities. This 
framework enables us to treat phenomena such as quan- 
tum phase transitions exhibited by the atom-cavity sys- 
tem and, in particular, to analyze the consequences of 
collective fluctuations, which play a pivotal role in the 
determination, formation and slow dynamics of various 
ordered states. We apply our framework to the case of 
a quasi-2D cloud of atoms confined in a concentric op- 
tical cavity, and find a transition to a spatially modu- 
lated state that realizes Brazovskii's transition [13 . The 
transition persists to zero temperature, thus becoming 
a quantum phase transition of an unusual universality 
class. In addition, we address the imprint of the asso- 
ciated quantum fluctuations in the correlations of the 
light emitted from the cavity. Finally, we generalize our 
model to incorporate strongly layered 3D distributions 
of atoms, and find that (in certain regimes) such sys- 
tems are unable to order globally because of frustration, 
and are expected, therefore, to develop inhomogeneous 
domain structures. Indications of such phenomena were 
observed in quantum Monte Carlo simulations [14]. In 
this work we identify the origin of these domains. 

The states we consider are "supersolids" in the sense 
that they are characterized by off-diagonal long-range or- 



II. ELEMENTS OF THE MODEL 

Near the ordering threshold, the strongest potential 
acting on the atoms is due to the standing wave of the 
pump lasers along the z direction (see Fig. [I]). The 
strength of the pump lasers at threshold determines the 
extent to which an atom is confined to an antinodal sheet 
of the pump standing wave. The weaker the coupling g 
between a single atom and a cavity mode, the stronger 
the laser must be to achieve threshold; in the regime we 
consider, g is weak enough that the atomic distribution is 
layered at threshold. Therefore, as a first step we analyze 
a system of atoms confined to a single layer. Such a situ- 
ation can be realized via selective loading techniques [17] . 

We start with the Hamiltonian H for a two- 
dimensional system of N two-level atoms interacting with 
the degenerate cavity modes and a spatially uniform 
transverse pump laser field [15] : 



N r 



H 



n=l 



(1) 



+ * J^GfoOO a l a n ~ h.c.) + ifl J2(cj- - a+) + H'. 

n,fi n 

The {a^} are cavity photon annihilation operators; 
g^x) = gE fI (x)^ where g is the atom-cavity coupling 
and S M is the normalized mode function of mode /i; 
ft is the pump laser strength; and the a operators are 
Pauli matrices that act on the pseudospin of the two- 
level atom. H' consists of dissipative terms arising from 
cavity loss (~ n) and spontaneous decay (~ 7); the 
effects of these terms will be discussed later. We as- 
sume throughout that the pump laser is slightly red- 
detuned from the cavity mode, and that both are sub- 
stantially red-detuned from the atomic transition, so that 
u L > {uja — ojl) > (wc — ml) > 0. For compact- 
ness, we re-express the frequencies in terms of detunings 
A a = — ~ — and Ac = 00c — 00 l. Further- 
more, we assume that the atom-cavity coupling g is weak 
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enough that g 2 N/AA <C ft, Ac, where n is the linewidth 
of the cavity. 



III. RING CAVITY 

Let us first consider the ring cavity, which sustains two 
degenerate counter-propagating cavity modes of mode 
functions e ±%Kx and wavevectors ±K [19 j. If the atoms 
scatter pump photons into both modes, and do so with 
a fixed phase relation between the modes, a standing 
wave is created in the cavity, and the system undergoes 
the same type of instability as in the single-mode case. 
There is, however, a crucial difference: the ring cavity 
has a continuous symmetry, because the cavity geome- 
try does not fix the location of the antinodes. Instead, 
the atoms must collectively fix a set of points, spaced A 
apart, at which to crystallize. The ordered state in the 
ring cavity is the simplest case, in ultracold-atom physics, 
of a system that spontaneously breaks a full, continuous, 
translational symmetry of space. 

In the mean-field approximation, the cavity mode am- 
plitudes obey the classical equations of motion arising 
from H: 



a±e 



-iujLt 



A c + %k + g 2 N/A A 
g 2 a T /A A 



N(x) e ±iKx dx 



A c + in + g 2 N/A A 



Near threshold, and in the weak-coupling limit (which 
implies a large threshold for the pump) , we can drop the 
second term on the RHS of Eqs. in which case the 
equations for a + and a_ decouple. We now eliminate 
the cavity modes from H, using the solutions of Eqs. ([2]), 
second-quantize the atoms as bosons, and expand the 
atomic field operators about the condensate as a/TV + 
to obtain for the approximate atomic Hamiltonian: 



h 2 K 2 



H= 2M 
where (N 



> (3) 



o _ -. Performing a Bogoliubov 

A^y A c +k 

transformation [20] yields the result that the polariton 
excitation of momentum K has energy 
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[For low nonzero temperatures T this dispersion relation 
continues to hold, provided the particle number N is re- 
placed by the condensate fraction No(T).] Upon increas- 
ing ( (e.g., by increasing Q) the uniform condensate be- 
comes unstable when ck = 0, i.e., when 
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For laser strengths greater than threshold, the uniform 
condensate is unstable with respect to a state that is 



spatially modulated with wavelength A, as discussed in 
Sec. [I] This spatial modulation is due to the macroscopic 
occupation by atoms of modes ip±K- The order param- 
eter for the transition is (ipx), a complex number whose 
phase, 0, determines the position of the antinodes, and 
which represents the Goldstone mode associated with the 
spontaneously broken translational symmetry. To find 
the steady-state value of the order parameter, we enforce 
number conservation, %j^ K ip K + ij^_ K + ^0 = ^> 
and minimize the energy with respect to the order pa- 
rameter (note that (N ~ g 2 N is an intensive quantity): 



(4>k) = ^ 



I2(N ■ 



h 2 K 2 
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Because (ip K ) — > at threshold, the transition is continu- 
ous. These results complement those of Nagy et al. [22] , 
who arrived at similar results via the Gross-Pitaevskii 
equation. They are slightly more general as they hold 
for nonzero temperatures below T c . 



IV. CONCENTRIC CAVITY 

For simplicity of presentation, most of this section 
will focus on one particular kind of multimode optical 
cavity, the concentric cavity. A concentric cavity con- 
sists of two (incomplete) spherical mirrors with coinci- 
dent centers of curvature. It can be thought of as a 
single sphere with a large strip around the meridian re- 
moved. Perfectly concentric cavities are unstable — they 
do not support localized optical modes — but it is possible 
to make nearly concentric cavities having stable modes 
that are still frequency-degenerate to within the cavity's 
linewidth. The analysis below focuses on concentric cav- 
ities because of their familiar symmetry structure, but 
almost all of it applies to any cavity having a family of 
degenerate modes, and in particular to the confocal cav- 
ity. 



A. Effective action 

The mean-field theory outlined above for the ring cav- 
ity is not adequate for describing ordering in concentric 
or confocal cavities, because the larger set of possibilities 
for ordering increases the importance of fluctuations. To 
incorporate fluctuations, it is convenient to formulate the 
description in terms of functional integration. This en- 
ables us to integrate out the atomic excited states and 
all of the photon states so as to construct an effective de- 
scription that focuses on the motion of the (ground state) 
atoms. In general, the atom-cavity system is driven, ow- 
ing to the pump laser, and dissipative, owing to cavity 
loss and spontaneous emission. Consequently, there is 
an energy flux through the system, which is proportional 
to Ng 2 below threshold and to {p^)N 2 g 2 above thresh- 
old, where (S M ) is the order parameter for ordering in 
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mode 11. As g ex F _1//2 , V being the volume of the sys- 
tem, in order to arrive at the thermodynamic limit at 
constant density, one keeps g 2 N constant (and small rel- 
ative to ft, as mentioned in Sec. II) as g decreases and 
N increases [8 . Under these assumptions, the energy 
flux per particle through the system is small near thresh- 
old, and we can approximate the system as dissipative 
but undriven. The dissipation can then be treated in 
the manner of Caldeira and Leggett [25]. Next, we make 
the rotating- wave approximation, which transforms fields 
that rotate at uol in the complex plane to static fields, 
so that the drive becomes a static coupling between the 
atoms and the cavity. Thus, we arrive at an effective 
description of the atom-cavity system in terms of equi- 
librium quantum statistical mechanics. 

In the uniform phase (i.e., below threshold), Q 2 ^> 
9 2 {\^m\ 2 )i and the leading part of the effective atomic 
action is: 

So = d 2 x i/j^ (cu u - V 2 - p) V>(^,x) (7) 
-JjYl [ ^ 2 ^^/i( x )^*(^i,x)^(^ 2 ,x) 

X j d 2 X / ^(x0^*(^3. X 0V ; (^4 5 X 0^1+^^3+^ 5 

where {uo v } are Matsubara frequencies [20] . The sec- 
ond term may be understood as follows: if the system 
were in a cubic box, so that the mode functions were 
e* K °' x , this term would have the form /?k P-k ? where 
Pk = (e* K °' x ) is a Fourier component of the density. 
Such a term is commonplace in the theory of crystal- 
lization (see, e.g., Ref. [26]), in which pk is often de- 
fined to be the order parameter. If the uniform state 

is a condensate, p Ko = E q (^q^K ) ~ V^Vo^Ko), i-e«, 
the expectation value approximately factorizes owing to 
the presence of off-diagonal long-range order. Therefore, 
(^k ) is a legitimate order parameter for crystallization, 
as we implicitly assumed in the previous section. 

For the concentric cavity, the mode structure for the 
light is referenced by the index in the pump direction /, 
the angular index m, and the radial index n; along the 
equatorial plane, / = modes have the highest ampli- 
tude, and we shall restrict to Z = in this section. In this 
case, the mode structure for both the light and the atoms 
is indexed by m and n. Assuming that the relevant cavity 
modes have spatial structure on lengthscales far smaller 
than the cavity size, the interaction term takes the form 
p rnn p-mn, where m + n c± K^R, with R being the radius 
of the cavity and Kq = 2tt/X. As the cavity- mediated 
interaction draws atoms into antinodal wells one wave- 
length apart from one another, it generates a softening 
in the atomic dispersion relation e mn , i.e., a trough near 
m + n ~ K R. We now develop a low-energy effective 
action for the atomic degrees of freedom in the vicinity 
of this trough, in order to examine whether it becomes 
energetically favorable, relative to the spatially uniform 



state, for the system to order. We consider two cases: 
(i) the classical transition at T > in the absence of a 
condensate, for which Ak does not factorize, and (ii) the 
quantum phase transition at T — 0, in the presence of 
a condensate, near which the dominant fluctuations are 
quantum mechanical. 

In the classical case, we introduce collective coordi- 
nates p mn to represent atomic density fluctuations, and 
then integrate out the microscopic atomic degrees of free- 
dom, to arrive at the effective action in terms of rescaled 
dimensionless fields: 



S e ff = ^ [r + x(m + n- K R) 2 ] p mn p- 



(8) 



N( 2 (k B T) 2 ^ 



where po is the area density of atoms, 



N(k B T 



(9) 



and x is a parameter that describes the width of the 
trough at Kq. Contributions to x arise from the intrin- 
sic linewidth of the cavity modes and from the further 
broadening due to the atoms-cavity coupling. There is 
no cubic term in the action because, to meet the require- 
ments for "momentum" conservation, such a term would 
have to involve at least one mode with m > KqR/2. 
However, modes with most of their structure in the angu- 
lar direction are suppressed because (i) such modes tend 
to have higher diffractive losses [T9] . and (ii) the atomic 
cloud is confined to the intersection of pump and cavity 
modes, near the center of the cavity, and is therefore lo- 
cated mostly near modes with low angular momentum, 
i.e., m « 0. 

Consequently, the effective action is not — as one might 
have expected — the Landau free energy for crystalliza- 
tion, but is instead a variant of Brazovskii's free en- 
ergy [13] , which describes phase transitions from isotropic 
to striped structures in various condensed matter set- 
tings, ranging from diblock copolymers [27] to connec- 
tive patterns [28 . Brazovskii's phase transition differs 
from many commonly studied phase transitions in an im- 
portant respect — the low-energy fluctuations active near 
most phase transitions are clustered about a point, or iso- 
lated set of points, in momentum space (frequently the 
origin). By contrast, for the Brazovskii case, as lone: as 
dimension d > 2, the low-energy fluctuations are clus- 
tered about a circular shell of nonzero radius, given by 
the stripe wavevector. This has two important conse- 
quences. First, the low-energy density of states is effec- 
tively one-dimensional, and scales as (e — eo) -1 ^ 2 , where 
eo is the energy of an excitation at wavevector Kq, regard- 
less of the physical dimensionality of the system; there- 
fore, the physics of Brazovskii's model is independent 
of the physical dimensionality of the system, as long as 
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FIG. 2: Ordered state with defects. The ordered states 
form two-dimensional patterns. This sketch shows a regime 
near threshold, with domains locally populating distinct cav- 
ity modes at the equatorial plane. Domains can be punctu- 
ated by dislocations (shown in the left-half of the figure), but 
might also show textural variation in space (right-half of fig- 
ure). The black lines represent nodes of the cavity field, which 
separate "even" and "odd" antinodes. The atomic population 
per site is not fixed because the atoms are Bose condensed. 



d>2. Second, the phase space for fluctuations is larger; 
therefore, fluctuations are strong enough to control not 
only the critical exponents at the transition but even the 
order of the transition itself. 

The mean-field threshold fi m f can be read off from the 
action S e ff by setting r = 0: 



h 2 K 2 h 2 Po . ln ^o 2 l 



hA c g 2 n 2 m , 



k B T, (10) 



2M 2MN \2M n) A\ (A 2 C + n 2 ) 

and the transition appears to be continuous. (Note that, 
although T > 0, we have assumed that T is low enough 
that the thermal de Broglie wavelength exceeds the lat- 
tice spacing; therefore, this result does not apply to point 
particles.) However, the true threshold for ordering, Q t h, 
once fluctuations are accounted for, is higher: 



Q 2 



ft 



Ai(A^ + K 2 )l 


-1/3 




9 2 A C \ 







2/3 



,V3 



(11) 



In addition, the transition is driven first-order: the order 
parameter jumps discontinuously from zero to a nonzero 
value. As with other first-order transitions, Brazovskii's 
transition proceeds by the nucleation and growth of 
droplets of the stable phase. The morphology of these 
droplets is known to be unusually rich: there are regimes 
dominated by anisotropic and diffuse droplets, as well 
as ones in which the droplets form "focal conic" struc- 
tures [29] . Qualitatively similar phenomena are expected 
to occur in the cavity QED setting, although the nature 
of the crossovers between regimes may be different. 

Having addressed the classical regime of the interact- 
ing Bose gas, we now turn to the other limit of interest: 
the quantum, zero-temperature limit. In this regime, an 
argument adapted from Ref. [20] yields the effective low- 



frequency action 

S = fdco [r + ^+x'irn + n-KoR) 2 ] |^ mn | 2 

^ ran ^ 

+ U J dtd 2 x\B(x,t)\ 4 + (12) 

where we have augmented the action with a contact re- 
pulsion term associated with the energy scale U. The 
field B describes the Bogoliubov quasi-particles, r' = 
(h 2 K 2 /2M) 2 - 2(h 2 K 2 /2M and x ' serves, as x did 
in the classical case, as a broadening of the constraint 
m + n c± KoR. The mean-field threshold in this case, 
which occurs when r = 0, is the same as in the ring 
cavity, discussed in Sec. III. The extra dimension arising 
from the integral over uo changes the spectrum of fluctu- 
ations; instead of a thin ribbon of fluctuations, we must 
now consider an anisotropic tube. In the limit that tem- 
poral fluctuations are of much lower energy than spatial 
ones, Brazovskii's analysis is applicable; in general, how- 
ever, we must adapt Brazovskii's argument to the case 
of d (rather than one) dimensions transverse to the line 
of soft modes m + n ~ KoR. In this case, power count- 
ing suggests that the case of d = 2 forms a boundary 
between transitions that are driven first-order and those 
that are not. Related issues have recently been addressed 
by Ref. [30]. It is plausible that at d = 2, the varia- 
tion of some parameter could tune the system from a 
Brazovskii-like regime in which the quantum phase tran- 
sition is first-order, via a tri-critical point, to a regime in 
which the transition is continuous. 

B. Correlation functions of emitted light 

Our approach can also be used to compute atom- 
atom correlation functions via standard functional or di- 
agrammatic techniques. Such atomic correlations are ex- 
perimentally obtainable through post-processing of light 
scattering and absorption images [31]. Additionally, 
transmission through the cavity mirrors provides an ex- 
perimentally accessible, real-time diagnostic channel for 
critical fluctuations in the correlations of the light emit- 
ted from the cavity. These optical correlations can be 
computed from our effective atomic theory by the field- 
theoretic technique of introducing a formal source term 
h a a a that couples linearly to the cavity mode \i. Near 
threshold, one expects the occurrence of "critical slowing 
down',' which manifests itself through the development of 
long-time (with respect to k) correlations in the emitted 
light, possibly characterized by an anomalous power-law. 

For instance, the low-frequency temporal photon cor- 
relation functions just below threshold are related to 
atomic correlation functions as follows: 



{°Ln( U ) a rnn{u)) -- 



c 



dJdJ'd xd x' g rnn {x)g mn {x') 



x (^(a/, x)ijj{uj - lj\ x)^(u", x')^(uo - uo", x')). (13) 
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The utility of this result is that it enables us to translate 
scaling arguments for the atomic correlations into scaling 
arguments for the photon correlations. At the Gaussian 
level, the photon correlators diverge as the control pa- 
rameter t' — > as follows: 

(a}nn(u)a mn (u)) ~ ^ 2 _ + — . (14) 

However, this result is expected to be inaccurate very 
close to the phase transition, as a result of nonlinear in- 
teractions between fluctuations. The theory of the diver- 
gence of correlation lengths and times near a quantum 
phase transition is described in Refs. [32j [33]. It is be- 
lieved that the chief consequence of an energy flux near 
a quantum phase transition is to act as an effective tem- 
perature [33[ |34[ [35] ; if one assumes that this holds for 
the concentric cavity, one can adapt the finite-size scaling 
hypothesis to predict that 

<aL»<wM> ~ 7-V(^7" z/2 , C7 1/2 , k/7), (15) 

where / is a scaling function, £ ~ [{h 2 K 2 /2M) — 2() v is 
the spatial correlation length of the system, v is a critical 
exponent, and r] is the scaling dimension of the correla- 
tion function. 



C. Character of ordered states and their defects 

Soft condensed matter systems that undergo Bra- 
zovskii's transition commonly form lamellar patterns. 
The present realization does not, owing to the influence of 
boundary conditions on the optical mode structure, and 
therefore on the possibilities for atomic crystallization. 
Instead, in the concentric cavity, the ordered states follow 
the optical mode patterns, which may be visualized as 
distorted checkerboard patterns, as shown in Fig. [2] The 
atomic density locally selects amongst the cavity modes 
by crystallizing into the "black or white squares" of the 
selected mode. Domains of crystallization are separated 
by localized defects or extended textures, which are ex- 
pected to coarsen over time. In physical realizations, the 
states of crystallization are not exactly degenerate, as 
optical modes having more angular structure (i.e., larger 
m) are of lower finesse; on the other hand, repulsive in- 
teractions have a stronger impact on atoms crystallizing 
into modes of lower m. Such effects can be accounted for 
within our model by the introduction of external fields 
that bias the system towards crystallizing into certain 
modes. 




FIG. 3: Effects due to frustration. Atoms are loaded into 
sheets (i) and (ii), marked in thick red lines in panel (a), which 
are an integer number of pump wavelengths apart. The blue 
[dashed] and orange [dash-dot] curves are, respectively, antin- 
odal regions of the modes TEMi m , which has low intensity 
near the centers of sheets (i) and (ii), and TEM2m, which 
has low intensity away from the centers of sheets (i) and (ii). 
Near the center of each sheet, atoms crystallize into TEM2 m ; 
away from the center, they crystallize into TEM lm / . Within 
a sheet, regions may be separated by a discommensuration, 
e.g., in the left side of panel (b), or a dislocation, e.g., in the 
right side of panel (b). Between sheets, the opposite parity of 
adjacent modes leads to frustration, which precludes order- 
ing, as in the regions indicated by a A and a □. Dislocations 
(□) are less energetically costly than discommensurations (A) 
because they are more localized. 

generate [19 . (It is also possible to make multimode cav- 
ities in which every p th TEM mode is degenerate.) These 
cavities have the practical advantage over the concentric 
cavity that their stability criteria are easier to fulfill. To 
the extent that it is legitimate to think of such cavities 
as having a continuous family of degenerate modes (i.e., 
if they possess a large number of modes that are both de- 
generate and not heavily suppressed by diffractive losses) , 
the self-organization transition in these cavities should 
belong to Brazovskii's universality class, and our analy- 
sis of the transition itself extends to these models. Where 
confocal cavities differ from concentric ones is in the ge- 
ometry of the ordered states and of their defects, which 
is much more involved in the confocal case because of its 
less-evident symmetry structure. 



V. OTHER MULTIMODE CAVITIES 



VI. FRUSTRATION IN LAYERED SYSTEMS 



The best-known example of a multimode cavity is the 
confocal cavity, in which all the even TEM modes are de- 



We have discussed how an equilibrium atomic cloud 
confined by the pump laser to a plane near the equato- 
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rial plane of the cavity spontaneously crystallizes globally 
into one of a family of degenerate checkerboard arrange- 
ments. Now let us consider an atomic cloud confined 
to a plane away from the equator of the cavity. In this 
case, spontaneous crystallization still occurs, but, as we 
shall now explain, the precise arrangement into which 
the atoms crystallize varies across the plane. This is a 
consequence of frustration (see, for example, Ref. [36] . 
Part II): satisfying local energetic preferences introduces 
"fault zones" between locally ordered regions. 

In our analysis of equatorial atomic distributions (see 
Fig. [2|, we were able to restrict the family of degenerate 
modes considered to TEM/ m with 1 = 0. To general- 
ize our analysis beyond the equatorial plane, we must 
consider all modes that meet the degeneracy condition 
I + m + n c± KqR. Consider the situation illustrated 
in Fig. [3^i, first focusing on the non-equatorial sheet 
marked (i). Near the center of the sheet, crystallization 
into modes with I = 1 is suppressed because they have 
low intensity, whereas crystallization into I = 2 modes is 
favored because they have maximal intensity; away from 
the center, the opposite is true. The change in I forces 
a change in m or n, owing to the degeneracy condition, 
so the mode functions in the sheet must change across 
an inter facial zone between the I = 1 and I = 2 regions. 
Therefore, either a dislocation, associated with a change 
in m, or an abrupt change in lattice periodicity (i.e., a 
discommensuration), associated with a change in n, is 
expected [38] . 

Now consider a situation in which two symmetrically 
disposed sheets on opposite sides of the equator are pop- 
ulated with atoms, as in sheets (i) and (ii) of Fig. [3)3. 
Atoms in sheet (i) and those in sheet (ii) are coupled via 
the cavity modes. Because I = 2 (Z = 1) mode func- 
tions are symmetric (antisymmetric) about the equato- 
rial plane, the atoms in the I = 2 (I = 1) arrangement 
in sheet (ii) occupy the same (opposite) checkerboard as 
those in sheet (i). If there are no dislocations, atoms 
in the inter facial zone remain disordered, because it is 
impossible for the atoms to satisfy both desiderata (or, 
equivalently, because the corresponding cavity modes in- 
terfere destructively in sheet (i) and constructively in 
sheet (ii)). The introduction of dislocations enables the 
system to order in part of the interfacial zone, as shown in 
the right hand side of Fig. (3}d, and is therefore preferred. 

The full many- layer, many- mode system is expected 
to experience the same kinds of disordering effects as 
the idealization sketched above: i.e., one expects sys- 
tems slightly above threshold to develop locally crys- 
talline phases separated by zones riddled with faults. 



VII. SUMMARY AND OUTLOOK 

Our objective in this paper is to discuss how quan- 
tum phases with emergent crystalline order, as well as 
the associated quantum phase transitions, can be real- 
ized and explored using ultracold atomic systems con- 



fined in multimode optical cavities. We have shown that 
the self-organization transition in a concentric cavity re- 
alizes Brazovskii's model of stripe formation, formerly 
confined to soft condensed matter physics, now in a quan- 
tal setting, and that the critical fluctuations near this 
transition are observable in the correlations of the light 
emitted from the cavity. As in Brazovskii's transition, 
one expects the weakly self-organized state to be punc- 
tuated by defects of unusual morphology, which should 
be manifest in experiments as dynamically fluctuating 
domains, and for which there is evidence in simulations 
[T4] . In addition, we have discussed how a multilayered 
atomic cloud is unable to order globally because of frus- 
tration, and is therefore likely to exhibit static domains. 

A ubiquitous feature of cavity QED systems, which we 
hope to elaborate on, is the role played by the delayed 
response of the cavity on the dynamics of defects and 
collective excitations. This feature is due to the fact that 
the transient photon population in a high-finesse cavity 
decays on a timescale proportional to the finesse of the 
cavity. While critical fluctuations, which take place 
on extremely long timescales, should not be modified, 
excitations of the ordered state may be modified by the 
delayed response. The formalism adopted in this paper 
can be extended, using influence functional or Keldysh 
techniques [23j[37], to address such issues. However, the 
slow, long-wavelength nature of the dynamics considered 
here make such techniques unnecessary for our current 
purposes. 

An experimentally relevant question is the extent 
to which the "supersolidity" of BECs in multimode 
cavities — their simultaneous possession of spontaneous 
crystalline and superfluid order, discussed here — enables 
one to test fundamental questions about supersolidity. 
A well-known system in condensed matter that may 
exhibit supersolidity is solid helium-4; this phenomenon 
has been studied by "missing moment of inertia" 
experiments [6 . One could imagine performing an 
analogous experiment using a self-organized BEC in a 
multimode cavity, and imparting angular momentum to 
the BEC, e.g., via the pump laser. Multimode cavity 
QED provides a tunable setting in which self-organized 
states spontaneously break the continuous translational 
and/or orientational symmetries of space, rather than 
the discrete symmetry between the even and odd sites 
of either a single mode cavity or an externally imposed 
lattice. Thus, it is expected to provide rich and fertile 
experimental terrain for probing quantum states of 
matter possessing emergent structural rigidity and 
superfluidity. This paper explores the bosonic sector 
of many-body multimode cavity QED; the creation 
of compliant lattices raises the prospect of realizing 
fermionic superfluidity via photon-mediated pairing of 
ultracold fermionic atoms. 
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